Interactive Sonification of Neural Activity
نویسندگان
چکیده
We discuss our ongoing research in sonification of neural activity as demonstrated in the “Fish and Chips” and “BrainWaves” projects. We argue that sonification can serve as an effective technique for the representation of complex spatial information such as neural activity due to the auditory system’s ability to perceive stimuli at a wide spatial cover and its inclination to perceive spatial patterns in sonic input. The paper discusses aesthetic and functional aspects of sonification in this context and describes the evolution of our technique, artistic approach, and interaction design – from the low-resolution graphical user interface in “Fish and Chips” to the highresolution tangible interaction with newly developed controllers in “BrainWaves”. We conclude with an evaluative discussion and a number of suggestions for future work.
منابع مشابه
Surface Interactions for Interactive Sonification
This paper presents novel interaction modes for Model-Based Sonification (MBS) via interactive surfaces. We first discuss possible interactions for MBS on a multi-touch surface. This is followed by a description of the Data Sonogram Sonification and the Growing Neural Gas Sonification Model and their implementation for the multi-touch interface. Modifications from the original sonification mode...
متن کاملSonic Interaction Design: New Applications and Challenges for Interactive Sonification
Sonic Interaction Design (SID) is the exploitation of sound as a principal channel to convey information, meaning as well as aesthetic and emotional qualities in interactive contexts [1]. SID is a new young research field that offers novel perspectives for interactive artefacts and multimodal user interfaces that use sound at the core of their designs as means to interact with the user or to co...
متن کاملA.i. in Real-time (automated and Interactive) Sonification (of Gesture Data) Generative Real-time Sonification A.i. in Real-time (automated and Interactive) Sonification (of Gesture Data)
Drawing on implementations of A.I. models for real-time music performance that produce an immediate sonification and visualisation display from gestural and audio input, this paper concerns three areas of relevance to a broader array of inter-domain implementation: integration of A.I. modules (Artifical Life, biologically-inspired and Evolutionary processes) in a system for real-time computatio...
متن کاملAn Interface for Live Interactive Sonification
Sonification is generally considered in a statistical data analysis context. This research discusses the development of an interface for live control of sonification – for controlling and altering sonifications over the course of their playback. This is designed primarily with real-time sources in mind, rather than with static datasets, and is intended as a performative, live data-art creative ...
متن کاملLearning Musical Instrument Skills Through Interactive Sonification
Interactive visualisation methods have been used to understand realtime acoustic analysis for the purpose of learning musical skills. However, interactive sonification has not often been considered, perhaps because it is assumed the musician cannot concentrate simultaneously on two sounds – their instrument’s sound, and the sonified information. However, whilst some finesse is required in desig...
متن کامل